Image Domain Multi-Material Decomposition Noise Suppression Through Basis Transformation and Selective Filtering.

Spectral CT can provide material characterization ability to offer more precise material information for diagnosis purposes. However, the material decomposition process generally leads to amplification of noise which significantly limits the utility of the material basis images. To mitigate such problem, an image domain noise suppression method was proposed in this work. The method performs basis transformation of the material basis images based on a singular value decomposition. The noise variances of the original spectral CT images were incorporated in the matrix to be decomposed to ensure that the transformed basis images are statistically uncorrelated. Due to the difference in noise amplitudes in the transformed basis images, a selective filtering method was proposed with the low-noise transformed basis image as guidance. The method was evaluated using both numerical simulation and real clinical dual-energy CT data. Results demonstrated that compared with existing methods, the proposed method performs better in preserving the spatial resolution and the soft tissue contrast while suppressing the image noise. The proposed method is also computationally efficient and can realize real-time noise suppression for clinical spectral CT images.

MLNAN: Multi-level noise-aware network for low-dose CT imaging implemented with constrained cycle Wasserstein generative adversarial networks.

Low-dose CT techniques attempt to minimize the radiation exposure of patients by estimating the high-resolution normal-dose CT images to reduce the risk of radiation-induced cancer. In recent years, many deep learning methods have been proposed to solve this problem by building a mapping function between low-dose CT images and their high-dose counterparts. However, most of these methods ignore the effect of different radiation doses on the final CT images, which results in large differences in the intensity of the noise observable in CT images. What'more, the noise intensity of low-dose CT images exists significantly differences under different medical devices manufacturers. In this paper, we propose a multi-level noise-aware network (MLNAN) implemented with constrained cycle Wasserstein generative adversarial networks to recovery the low-dose CT images under uncertain noise levels. Particularly, the noise-level classification is predicted and reused as a prior pattern in generator networks. Moreover, the discriminator network introduces noise-level determination. Under two dose-reduction strategies, experiments to evaluate the performance of proposed method are conducted on two datasets, including the simulated clinical AAPM challenge datasets and commercial CT datasets from United Imaging Healthcare (UIH). The experimental results illustrate the effectiveness of our proposed method in terms of noise suppression and structural detail preservation compared with several other deep-learning based methods. Ablation studies validate the effectiveness of the individual components regarding the afforded performance improvement. Further research for practical clinical applications and other medical modalities is required in future works.

TT U-Net: Temporal Transformer U-Net for Motion Artifact Reduction Using PAD (Pseudo All-Phase Clinical-Dataset) in Cardiac CT.

Involuntary motion of the heart remains a challenge for cardiac computed tomography (CT) imaging. Although the electrocardiogram (ECG) gating strategy is widely adopted to perform CT scans at the quasi-quiescent cardiac phase, motion-induced artifacts are still unavoidable for patients with high heart rates or irregular rhythms. Dynamic cardiac CT, which provides functional information of the heart, suffers even more severe motion artifacts. In this paper, we develop a deep learning based framework for motion artifact reduction in dynamic cardiac CT. First, we build a PAD (Pseudo All-phase clinical-Dataset) based on a whole-heart motion model and single-phase cardiac CT images. This dataset provides dynamic CT images with realistic-looking motion artifacts that help to develop data-driven approaches. Second, we formulate the problem of motion artifact reduction as a video deblurring task according to its dynamic nature. A novel TT U-Net (Temporal Transformer U-Net) is proposed to excavate the spatiotemporal features for better motion artifact reduction. The self-attention mechanism along the temporal dimension effectively encodes motion information and thus aids image recovery. Experiments show that the TT U-Net trained on the proposed PAD performs well on clinical CT scans, which substantiates the effectiveness and fine generalization ability of our method. The source code, trained models, and dynamic demo will be available at https://github.com/ivy9092111111/TT-U-Net.

Fast and low-dose medical imaging generation empowered by hybrid deep-learning and iterative reconstruction.

Fast and low-dose reconstructions of medical images are highly desired in clinical routines. We propose a hybrid deep-learning and iterative reconstruction (hybrid DL-IR) framework and apply it for fast magnetic resonance imaging (MRI), fast positron emission tomography (PET), and low-dose computed tomography (CT) image generation tasks. First, in a retrospective MRI study (6,066 cases), we demonstrate its capability of handling 3- to 10-fold under-sampled MR data, enabling organ-level coverage with only 10- to 100-s scan time; second, a low-dose CT study (142 cases) shows that our framework can successfully alleviate the noise and streak artifacts in scans performed with only 10% radiation dose (0.61 mGy); and last, a fast whole-body PET study (131 cases) allows us to faithfully reconstruct tumor-induced lesions, including small ones (<4 mm), from 2- to 4-fold-accelerated PET acquisition (30-60 s/bp). This study offers a promising avenue for accurate and high-quality image reconstruction with broad clinical value.

Unsharp Structure Guided Filtering for Self-Supervised Low-Dose CT Imaging.

Low-dose computed tomography (LDCT) imaging faces great challenges. Although supervised learning has revealed great potential, it requires sufficient and high-quality references for network training. Therefore, existing deep learning methods have been sparingly applied in clinical practice. To this end, this paper presents a novel Unsharp Structure Guided Filtering (USGF) method, which can reconstruct high-quality CT images directly from low-dose projections without clean references. Specifically, we first employ low-pass filters to estimate the structure priors from the input LDCT images. Then, inspired by classical structure transfer techniques, deep convolutional networks are adopted to implement our imaging method which combines guided filtering and structure transfer. Finally, the structure priors serve as the guidance images to alleviate over-smoothing, as they can transfer specific structural characteristics to the generated images. Furthermore, we incorporate traditional FBP algorithms into self-supervised training to enable the transformation of projection domain data to the image domain. Extensive comparisons and analyses on three datasets demonstrate that the proposed USGF has achieved superior performance in terms of noise suppression and edge preservation, and could have a significant impact on LDCT imaging in the future.

Patient-specific fetal radiation dosimetry for pregnant patients undergoing abdominal and pelvic CT imaging.

BACKGROUND: Accurate estimation of fetal radiation dose is crucial for risk-benefit analysis of radiological imaging, while the radiation dosimetry studies based on individual pregnant patient are highly desired. PURPOSE: To use Monte Carlo calculations for estimation of fetal radiation dose from abdominal and pelvic computed tomography (CT) examinations for a population of patients with a range of variations in patients' anatomy, abdominal circumference, gestational age (GA), fetal depth (FD), and fetal development. METHODS: Forty-four patient-specific pregnant female models were constructed based on CT imaging data of pregnant patients, with gestational ages ranging from 8 to 35 weeks. The simulation of abdominal and pelvic helical CT examinations was performed on three validated commercial scanner systems to calculate organ-level fetal radiation dose. RESULTS: The absorbed radiation dose to the fetus ranged between 0.97 and 2.24 mGy, with an average of 1.63 ± 0.33 mGy. The CTDIvol -normalized fetal dose ranged between 0.56 and 1.30, with an average of 0.94 ± 0.25. The normalized fetal organ dose showed significant correlations with gestational age, maternal abdominal circumference (MAC), and fetal depth. The use of ATCM technique increased the fetal radiation dose in some patients. CONCLUSION: A technique enabling the calculation of organ-level radiation dose to the fetus was developed from models of actual anatomy representing a range of gestational age, maternal size, and fetal position. The developed maternal and fetal models provide a basis for reliable and accurate radiation dose estimation to fetal organs.

TIME-Net: Transformer-Integrated Multi-Encoder Network for limited-angle artifact removal in dual-energy CBCT.

Dual-energy cone-beam computed tomography (DE-CBCT) is a promising imaging technique with foreseeable clinical applications. DE-CBCT images acquired with two different spectra can provide material-specific information. Meanwhile, the anatomical consistency and energy-domain correlation result in significant information redundancy, which could be exploited to improve image quality. In this context, this paper develops the Transformer-Integrated Multi-Encoder Network (TIME-Net) for DE-CBCT to remove the limited-angle artifacts. TIME-Net comprises three encoders (image encoder, prior encoder, and transformer encoder), two decoders (low- and high-energy decoders), and one feature fusion module. Three encoders extract various features for image restoration. The feature fusion module compresses these features into more compact shared features and feeds them to the decoders. Two decoders perform differential learning for DE-CBCT images. By design, TIME-Net could obtain high-quality DE-CBCT images using two complementary quarter-scans, holding great potential to reduce radiation dose and shorten the acquisition time. Qualitative and quantitative analyses based on simulated data and real rat data have demonstrated the promising performance of TIME-Net in artifact removal, subtle structure restoration, and reconstruction accuracy preservation. Two clinical applications, virtual non-contrast (VNC) imaging and iodine quantification, have proved the potential utility of the DE-CBCT images provided by TIME-Net.

DREAM-Net: Deep Residual Error Iterative Minimization Network for Sparse-View CT Reconstruction.

Sparse-view Computed Tomography (CT) has the ability to reduce radiation dose and shorten the scan time, while the severe streak artifacts will compromise anatomical information. How to reconstruct high-quality images from sparsely sampled projections is a challenging ill-posed problem. In this context, we propose the unrolled Deep Residual Error iterAtive Minimization Network (DREAM-Net) based on a novel iterative reconstruction framework to synergize the merits of deep learning and iterative reconstruction. DREAM-Net performs constraints using deep neural networks in the projection domain, residual space, and image domain simultaneously, which is different from the routine practice in deep iterative reconstruction frameworks. First, a projection inpainting module completes the missing views to fully explore the latent relationship between projection data and reconstructed images. Then, the residual awareness module attempts to estimate the accurate residual image after transforming the projection error into the image space. Finally, the image refinement module learns a non-standard regularizer to further fine-tune the intermediate image. There is no need to empirically adjust the weights of different terms in DREAM-Net because the hyper-parameters are embedded implicitly in network modules. Qualitative and quantitative results have demonstrated the promising performance of DREAM-Net in artifact removal and structural fidelity.

Improving image quality and lung nodule detection for low-dose chest CT by using generative adversarial network reconstruction.

OBJECTIVES: To investigate the improvement of two denoising models with different learning targets (Dir and Res) of generative adversarial network (GAN) on image quality and lung nodule detectability in chest low-dose CT (LDCT). METHODS: In training phase, by using LDCT images simulated from standard dose CT (SDCT) of 200 participants, Dir model was trained targeting SDCT images, while Res model targeting the residual between SDCT and LDCT images. In testing phase, a phantom and 95 chest LDCT, exclusively with training data, were included for evaluation of imaging quality and pulmonary nodules detectability. RESULTS: For phantom images, structural similarity, peak signal-to-noise ratio of both Res and Dir models were higher than that of LDCT. Standard deviation of Res model was the lowest. For patient images, image noise and quality of both two models, were better than that of LDCT. Artifacts of Res model was less than that of LDCT. The diagnostic sensitivity of lung nodule by two readers for LDCT, Res and Dir model, were 72/77%, 79/83% and 72/79% respectively. CONCLUSION: Two GAN denoising models, including Res and Dir trained with different targets, could effectively reduce image noise of chest LDCT. The image quality evaluation scoring and nodule detectability of Res denoising model was better than that of Dir denoising model and that of hybrid IR images. ADVANCES IN KNOWLEDGE: The GAN-trained model, which learned the residual between SDCT and LDCT images, reduced image noise and increased the lung nodule detectability by radiologists on chest LDCT. This demonstrates the potential for clinical benefit.

A deep learning method for eliminating head motion artifacts in computed tomography.

PURPOSE: Involuntary patient movement results in data discontinuities during computed tomography (CT) scans which lead to a serious degradation in the image quality. In this paper, we specifically address artifacts induced by patient motion during a head scan. METHOD: Instead of trying to solve an inverse problem, we developed a motion simulation algorithm to synthesize images with motion-induced artifacts. The artifacts induced by rotation, translation, oscillation and any possible combination are considered. Taking advantage of the powerful learning ability of neural networks, we designed a novel 3D network structure with both a large reception field and a high image resolution to map the artifact-free images from artifact-contaminated images. Quantitative results of the proposed method were evaluated against the results of U-Net and proposed networks without dilation structure. Thirty sets of motion contaminated images from two hospitals were selected to do a clinical evaluation. RESULT: Facilitating the training dataset with artifacts induced by variable motion patterns and the neural network, the artifact can be removed with good performance. Validation dataset with simulated random motion pattern showed outperformed image correction, and quantitative results showed the proposed network had the lowest normalized root-mean-square error, highest peak signal-to-noise ratio and structure similarity, indicating our network gave the best approximation of gold standard. Clinical image processing results further confirmed the effectiveness of our method. CONCLUSION: We proposed a novel deep learning-based algorithm to eliminate motion artifacts. The convolutional neural networks trained with synthesized image pairs achieved promising results in artifacts reduction. The corrected images increased the diagnostic confidence compared with artifacts contaminated images. We believe that the correction method can restore the ability to successfully diagnose and avoid repeated CT scans in certain clinical circumstances.

CLEAR: Comprehensive Learning Enabled Adversarial Reconstruction for Subtle Structure Enhanced Low-Dose CT Imaging.

X-ray computed tomography (CT) is of great clinical significance in medical practice because it can provide anatomical information about the human body without invasion, while its radiation risk has continued to attract public concerns. Reducing the radiation dose may induce noise and artifacts to the reconstructed images, which will interfere with the judgments of radiologists. Previous studies have confirmed that deep learning (DL) is promising for improving low-dose CT imaging. However, almost all the DL-based methods suffer from subtle structure degeneration and blurring effect after aggressive denoising, which has become the general challenging issue. This paper develops the Comprehensive Learning Enabled Adversarial Reconstruction (CLEAR) method to tackle the above problems. CLEAR achieves subtle structure enhanced low-dose CT imaging through a progressive improvement strategy. First, the generator established on the comprehensive domain can extract more features than the one built on degraded CT images and directly map raw projections to high-quality CT images, which is significantly different from the routine GAN practice. Second, a multi-level loss is assigned to the generator to push all the network components to be updated towards high-quality reconstruction, preserving the consistency between generated images and gold-standard images. Finally, following the WGAN-GP modality, CLEAR can migrate the real statistical properties to the generated images to alleviate over-smoothing. Qualitative and quantitative analyses have demonstrated the competitive performance of CLEAR in terms of noise suppression, structural fidelity and visual perception improvement.

DaNet: dose-aware network embedded with dose-level estimation for low-dose CT imaging.

Many deep learning (DL)-based image restoration methods for low-dose CT (LDCT) problems directly employ the end-to-end networks on low-dose training data without considering dose differences. However, the radiation dose difference has a great impact on the ultimate results, and lower doses increase the difficulty of restoration. Moreover, there is increasing demand to design and estimate acceptable scanning doses for patients in clinical practice, necessitating dose-aware networks embedded with adaptive dose estimation. In this paper, we consider these dose differences of input LDCT images and propose an adaptive dose-aware network. First, considering a large dose distribution range for simulation convenience, we coarsely define five dose levels in advance as lowest, lower, mild, higher and highest radiation dose levels. Instead of directly building the end-to-end mapping function between LDCT images and high-dose CT counterparts, the dose level is primarily estimated in the first stage. In the second stage, the adaptively learned low-dose level is used to guide the image restoration process as the pattern of prior information through the channel feature transform. We conduct experiments on a simulated dataset based on original high dose parts of American Association of Physicists in Medicine challenge datasets from the Mayo Clinic. Ablation studies validate the effectiveness of the dose-level estimation, and the experimental results show that our method is superior to several other DL-based methods. Specifically, our method provides obviously better performance in terms of the peak signal-to-noise ratio and visual quality reflected in subjective scores. Due to the dual-stage process, our method may suffer limitations under more parameters and coarse dose-level definitions, and thus, further improvements in clinical practical applications with different CT equipment vendors are planned in future work.

Domain Progressive 3D Residual Convolution Network to Improve Low-Dose CT Imaging.

The wide applications of X-ray computed tomography (CT) bring low-dose CT (LDCT) into a clinical prerequisite, but reducing the radiation exposure in CT often leads to significantly increased noise and artifacts, which might lower the judgment accuracy of radiologists. In this paper, we put forward a domain progressive 3D residual convolution network (DP-ResNet) for the LDCT imaging procedure that contains three stages: sinogram domain network (SD-net), filtered back projection (FBP), and image domain network (ID-net). Though both are based on the residual network structure, the SD-net and ID-net provide complementary effect on improving the final LDCT quality. The experimental results with both simulated and real projection data show that this domain progressive deep-learning network achieves significantly improved performance by combing the network processing in the two domains.

Deep iterative reconstruction estimation (DIRE): approximate iterative reconstruction estimation for low dose CT imaging.

The image quality in low dose computed tomography (LDCT) can be severely degraded by amplified mottle noise and streak artifacts. Although the iterative reconstruction (IR) algorithms bring sound improvements, their high computation cost remains a major inconvenient. In this work, a deep iterative reconstruction estimation (DIRE) strategy is developed to estimate IR images from LDCT analytic reconstructions images. Within this DIRE strategy, a 3D residual convolutional network (3D ResNet) architecture is proposed. Experiments on several simulated and real datasets as well as comparisons with state-of-the-art methods demonstrate that the proposed approach is effective in providing improved LDCT images.

Micro-computed tomography-guided, non-equal voxel Monte Carlo method for reconstruction of fluorescence molecular tomography.

The study of dual-modality technology which combines microcomputed tomography (micro-CT) and fluorescence molecular tomography (FMT) has become one of the main focuses in FMT. However, because of the diversity of the optical properties and irregular geometry for small animals, a reconstruction method that can effectively utilize the high-resolution structural information of micro-CT for tissue with arbitrary optical properties is still one of the most challenging problems in FMT. We develop a micro-CT-guided non-equal voxel Monte Carlo method for FMT reconstruction. With the guidance of micro-CT, precise voxel binning can be conducted on the irregular boundary or region of interest. A modified Laplacian regularization method is also proposed to accurately reconstruct the distribution of the fluorescent yield for non-equal space voxels. Simulations and phantom experiments show that this method not only effectively reduces the loss of high-resolution structural information of micro-CT in irregular boundaries and increases the accuracy of the FMT algorithm in both forward and inverse problems, but the method also has a small Jacobian matrix and a short reconstruction time. At last, we performed small animal imaging to validate our method.

Molecular imaging of small animals with fluorescent proteins: from projection to multimodality.

Fluorescent proteins (FPs) have been widely adopted in cell research for protein trafficking and reporter gene expression studies, as well as to study other biological processes. However, biological tissue has high light scattering and high absorption coefficients of visible light; hence, using FPs in small animal imaging remains a challenge, especially when the FPs are located deep in the tissue. In small animals, fluorescence molecular imaging could potentially address this difficulty. We constructed fluorescence molecular imaging systems that have two modes: a planner mode (projection imaging) and a multimodality mode (fluorescence molecular tomography and micro-CT). The planner mode can provide projection images of a fluorophore in the whole body of a small animal, whereas three-dimensional information can be offered by multimodality mode. The planner imaging system works in the reflection mode and is designed to provide fast imaging. The multimodality imaging system is designed to allow quantification and three-dimensional localization of fluorophores. A nude mouse with a tumour targeted with a far-red FP, which is appropriate for in vivo imaging, was adopted to validate the two systems. The results indicate that the planner imaging system is probably suitable for high throughput molecular imaging, whereas the multimodality imaging system is fit for quantitative research.

Monte Carlo-based fluorescence molecular tomography reconstruction method accelerated by a cluster of graphic processing units.

High-speed fluorescence molecular tomography (FMT) reconstruction for 3-D heterogeneous media is still one of the most challenging problems in diffusive optical fluorescence imaging. In this paper, we propose a fast FMT reconstruction method that is based on Monte Carlo (MC) simulation and accelerated by a cluster of graphics processing units (GPUs). Based on the Message Passing Interface standard, we modified the MC code for fast FMT reconstruction, and different Green's functions representing the flux distribution in media are calculated simultaneously by different GPUs in the cluster. A load-balancing method was also developed to increase the computational efficiency. By applying the Fréchet derivative, a Jacobian matrix is formed to reconstruct the distribution of the fluorochromes using the calculated Green's functions. Phantom experiments have shown that only 10 min are required to get reconstruction results with a cluster of 6 GPUs, rather than 6 h with a cluster of multiple dual opteron CPU nodes. Because of the advantages of high accuracy and suitability for 3-D heterogeneity media with refractive-index-unmatched boundaries from the MC simulation, the GPU cluster-accelerated method provides a reliable approach to high-speed reconstruction for FMT imaging.

Combined system of fluorescence diffuse optical tomography and microcomputed tomography for small animal imaging.

We developed a dual-modality system that combines fluorescence diffuse optical tomography (fDOT) and flat panel detector-based microcomputed tomography (micro-CT) to simultaneously reveal molecular and structural information in small animals. In fDOT, a 748 nm diode laser was used as an excitation source, while a cooled charge coupled device camera was adopted to collect transmission fluorescence. In micro-CT, a flat panel detector based on amorphous silicon, with active area of 13 x 13 cm(2), and a microfocus x-ray tube were used. The fDOT system was mounted orthogonally to the micro-CT and the projection images were acquired without rotation of the sample, which is different from the method used for micro-CT alone. Both the finite element method and the algebraic reconstruction technique were used to reconstruct images from the fDOT. Phantom data showed that the resolution of the fDOT system was about 3 mm at an imaging depth of 7 mm. Quantitative error was no more than 5% and imaging sensitivity for 1,1(')-dioctadecyl-3,3,3('),3(')-etramethylindotricarbocyanine iodide bis-oleate (DiR-BOA) was estimated to be higher than 100 nM at a depth of 7 mm. Calculations of the phantom's center of mass showed that the location accuracy of fDOT was about 0.7 mm. We applied a Feldkamp algorithm to reconstruct the micro-CT image. By measuring the presampled modulation transfer function with a 30 microm tungsten thread, we estimated that the micro-CT has a resolution of 5 mm(-1) when the field of view was 6.5 cm. Our results indicate the uniformity of the transaxial micro-CT image and the contrast-to-noise ratio was measured as 1.95 for a radiation dose of 1 cGy. A non-image-based method was employed for merging images from the two imaging modalities. A nude mouse with DiR-BOA, imaged ex vivo, was used to validate the feasibility of the dual-modality system.